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(54) Abstract Title: Authoring of complex audiovisual products 

(57) An authoring method for creating an audiovisual (AV) 

product has three main stages: creation of an abstraction 
101; expansion of AV assets and a data structure 102; and 
creation of the product in a predetermined format, such as a 
DVD-video format 103. The first stage 101 defines 
components which implicitly represent functional sections 
of AV content and transitions between components. The 
second stage 102 expands the components and transitions 
to provide a set of explicitly realised AV assets and an 
intermediate data structure of nodes associated with one of 
the AV assets and links which represent movement from 
one node to another. The third stage 103 uses the AV assets, 
and the data-structure of nodes and links to create the AV 
product in a predetermined output format. Components 
may: be chosen with reference to a presentation template; 
comprise an authoring parameter; and comprise a 
meta-component representing a set of components. 
Transitions may comprise a trigger event which can occur 
during playback such as a user command or expiry of a 
timer. The predetermined format may have a hierarchical 
structure and two optional stages 104, 105 check whether 
the results will conform to limitations of that structure. 
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AUTHORING OF COMPLEX AUDIOVISUAL PRODUCTS 

The present invention relates in general to a method 
and apparatus for authoring complex audiovisual products . 

In general terms, it is desired to assemble many small 
sections of raw audio and video content (i.e. sound clips 
and video clips) to form a finished audiovisual product, 
by way of an authoring process. However, in many 
environments a considerable degree of specialist knowledge 
and time must be invested in the authoring process in 
order to achieve a desirable finished audiovisual product. 
These problems are exacerbated where the audiovisual 
product has a complex navigational structure or requires 
many separate raw content objects. 

As a simple example, a feature movie or television 
program typically has a straightforward linear 
navigational sequence of individual scenes. By contrast, 
it is now desired to develop new categories of audiovisual 
products which have a much more complex navigational 
structure, such as a movie with many scene choices or 
different movie endings, and/or which have a large number 
of individual scenes, such as an interactive quiz game 
with say one thousand individual quiz questions. 

In one preferred embodiment, the present invention 
relates to authoring of audiovisual content into a form 
compliant with a specification for DVD-video and able to 
be recorded on an optical disc recording medium. 

An optical disc is a convenient storage media for many 
different purposes. A digital versatile disc (DVD) has 
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been developed with a capacity of up to 4.7Gb on a single- 
sided single^layer disc, and up to 17Gb on a double-sided 
double -layer disc. There are presently several different 
formats for recording data onto, a DVD disc, including DVD- 
5 video, DVD-audio, and DVD RAM, amongst others. Of these, 
DVD-video is particularly intended for use with 
pre-recorded video content, such as a motion picture. As 
a result of the large storage capacity and ease of use, 
DVD discs are becoming popular and commercially important. 

10 Conveniently, a DVD-video disc is played using a dedicated 
playback device with relatively simple user controls, and 
DVD players for playing DVD-video discs are becoming 
relatively widespread. More detailed background 
information concerning the DVD-video specification is 

15 available from DVD Forum at www . dvdf orum . org . 

Although DVD- video discs and DVD- video players are 
becoming popular and widespread, at present only a limited 
range of content has been developed. In particular, a 

20 problem arises in that, although the DVD specification is 
very flexible, it is also very complex. The process of 
authoring content into a DVD- video compatible format is 
relatively expensive and time consuming. In practice, the 
flexibility and functions allowed in the DVD-video 

25 specification are compromised by the expensive and time 
consuming authoring task. Consequently, current DVD- video 
discs are relatively simple in their navigational 
complexity. Such simplicity can impede a user's enjoyment 
of a DVD-video disc, and also inhibits the development of 

30 new categories of DVD-video products. 

An example DVD authoring tool is disclosed in 
WO 99/38098 (Spruce Technologies) which provides an 



interactive graphical authoring interface and data 
management engine. This known authoring tool requires a 
relatively knowledgeable and experienced operator and 
encounters difficulties when attempting to develop an 
audiovisual product having a complex navigational 
structure. In particular, despite providing a graphical 
user interface, the navigational structure of the desired 
DVD-video product must be explicitly defined by the 
author. Hence, creating a DVD-video product with a complex 
navigational structure is expensive, time-consuming and 
error-prone. 

An aim of the present invention is to provide a 
convenient and simple method and apparatus for authoring 
an audio-visual product. 

An aim of the preferred embodiments of the present 
invention is to provide a method and apparatus able to 
create an audio-visual product having a complex 
navigational structure and/or having many individual 
content objects, whilst reducing a time required for 
authoring and minimising a need for highly skilled 
operators. 

Another preferred aim is to provide an authoring tool 
which is intuitive to use and is highly flexible. 

An aim of particularly preferred embodiments of the 
invention is to allow efficient creation of audio-visual 
products such as DVD-video products that run on commonly 
available DVD- video players. 
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According to the present invention there is provided a 
method and apparatus as set forth in the appended claims. 
Preferred features of the invention will be apparent from 
the dependent claims, and the description which follows. 



30 



is 



In a. first aspect of the present invention there 
provided an authoring method for use in creating an 
audiovisual product, comprising the steps of: defining a 
plurality of components, the components implicitly 
10 representing functional sections of audiovisual content 
with respect to one or more raw content objects, and a 
plurality of transitions that represent movements between 
the plurality of components; expanding the plurality of 
components and the plurality of transitions to provide a 
15 set of explicitly realised AV assets and an expanded 
intermediate datastructure of nodes and links, where each 
node is associated with an AV asset of the set and the 
links represent movement from one node to another; and 
creating an audiovisual product in a predetermined output 
format, using the AV assets and the expanded intermediate 
datastructure of the nodes and the links. 

In a second aspect of the present invention there is 
provided an authoring method for use in creating a DVD- 
video product, comprising the steps of: creating a 
plurality of components representing parameterised 
sections of audiovisual content, and a plurality of 
transitions representing movements between components; 
expanding the plurality of components and the plurality of 
transitions to provide a set of AV assets and an expanded 
datastructure of nodes and links, where each node is 
associated with an AV asset of the set and the links 
represent movement from one node to another; and creating 
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a DVD-video format datastructure from the AV assets, using 
the nodes and links. 

In a third aspect of the present invention there is 
5 provided an authoring method for use in creating an 
audiovisual product according to a DVD-video 
specification, comprising the steps of: generating a set 
of AV assets each comprising a video object, zero or more 
audio objects and zero or more sub-picture objects, and an 
10 expanded datastructure of nodes and links, where each node 
is associated with one AV asset of the set and the links 
represent navigational movement from one node to another; 
and creating a DVD-video format datastructure from the set 
of AV assets, using the nodes and links; the method 
15 characterised by the steps of: creating a plurality of 
components and a plurality of transitions, where a 
component implicitly defines a plurality of AV assets by 
referring to a presentation template and to items of raw 
content substitutable in the presentation template, and 
20 the plurality of transitions represent navigational 
movements between components; and expanding the plurality 
of components and the plurality of transitions to generate 
the set of AV assets and the expanded datastructure of 
nodes and links. 

25 

In another aspect the present invention there is 
provided a recording medium having recorded thereon 
computer implementable instructions for performing any of 
the methods defined herein. 

30 

In yet another aspect of the present invention there 
is provided a recording medium having recorded thereon an 



audiovisual product authored according to any of the 
methods defined herein. 

For a better understanding of the invention, and to 
show how embodiments of the same may be carried into 
effect, reference will now be made, by way of example, to 
the accompanying diagrammatic drawings in which: 

Figure 1 is an overview of an authoring method 
according to a preferred embodiment of the present 
invention; 

Figure 2 is a schematic diagram showing a simple 
abstraction of a desired audiovisual product; 

Figure 3 shows in more detail a component used as part 
of the abstraction of Figure 2; 

Figure 4 shows an example prior art authoring method 
compared with an example preferred embodiment of the 
present authoring method ; 

Figure 5 shows another example embodiment of the 
present authoring method using components and transitions; 

Figure 6 shows the example of Figure 5 in a tabular 
format ; 

Figure 7 is an overview of a method for evaluating 
components and transitions; 

Figure 8 shows evaluation of components in more 
detail ; 



Figure 9 shows evaluation of transitions in more 
detail; 

Figure 10 shows a portion of an expanded datastructure 
during evaluation of components and transitions; 

Figure 11 is an overview of a preferred method for 
creating DVD- video structures from an expanded 
datastructure; 

Figure 12 shows a step of creating DVD video structure 
locations in more detail; and 

Figure 13 shows a step of creating DVD-video 
compatible datastructures in more detail. 

Figure 1 shows an overview of an authoring method 
according to a preferred embodiment of the present 
invention. The present invention is applicable when 
authoring many types of audiovisual products, and in 
particular when complex navigational structure or content 
are involved . 

As one example, the present invention is applicable to 
authoring of video on demand products delivered remotely 
from a service provider to a user, such as over a computer 
network or other telecommunications network. Here, the 
present invention is especially useful in authoring 
interactive products, where user choices and responses 
during playback of the product dictate navigational flow 
or content choices. 
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As another example, the present invention is 
particularly suitable for use in the authoring of an 
audiovisual product compliant with a DVD-video 
specification. This example will be discussed in more 
detail below in order to illustrate the preferred 
arrangements of present invention. The audiovisual product 
is suitably recorded onto a recording medium such as an 
optical disk. The DVD-video specification defines a series 
of data objects that are arranged in a hierarchical 
structure, with strict . limits on the maximum number of 
objects that exist at each level of the hierarchy. Hence, 
in one preferred embodiment of the present invention it is 
desired to create an audiovisual product which meets these 
and other limitations of the specification. In particular 
it is desired that the resultant audiovisual product will 
play on commonly available DVD players. However, it is 
also desired to create the audiovisual product having a 
complex navigational structure, in order to increase a 
user's enjoyment of the product, and in order to allow the 
creation of new categories of audiovisual products. 

In the field of DVD-video, audiovisual content is 
considered in terms of audio-visual assets (also called AV 
assets or presentation objects) . According to the DVD- 
video specification each AV asset contains at least one 
video object, zero or more audio objects, and zero or more 
sub-picture objects. That is, a section of video data is 
presented along with synchronised audio tracks and 
optional sub-picture objects. The current DVD-video 
specification allows up to eight different audio tracks 
(audio streams) to be provided in association with up to 
nine video objects (video angle streams) . Typically, the 
video streams represent different camera angles, whilst 



the audio streams represent different language versions of 
a soundtrack such as English, French, Arabic etc. Usually, 
only one of the available video and audio streams is 
selected and reproduced when, the DVD-video product is 
played back. Similarly, the current specification allows 
up to thirty- two sub-picture streams, which are used for 
functions such as such as language subtitles. Again, 
typically only one of the sub-picture streams is selected 
and played back, to give for example a movie video clip 
with English subtitles from the sub-picture stream 
reproduced in combination with a French audio stream. Even 
this relatively simple combination of video, audio and 
sub-picture streams requires a high degree of co- 
ordination and effort during authoring, in order to 
achieve a finished product such as a feature movie. Hence, 
due to the laborious and expensive nature of the authoring 
process there is a strong disincentive that inhibits the 
development of high-quality audiovisual products according 
to the DVD-video specification. There is then an even 
stronger impediment against the development of audiovisual 
products with complex navigational flow or using high 
numbers of individual raw content objects. 

Conveniently, the authoring method of the present 
invention is implemented as a program, or a suite of 
programs. The program or programs are recorded on any 
suitable recording medium, including a removable storage 
such as a magnetic disk, hard disk or solid state memory 
card, or as a signal modulated onto a carrier for 
transmission on any suitable data network, such as the 
internet . 
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In use, the authoring method is suitably performed on 
a computing platform, ideally a general purpose computing 
platform such as -a personal computer or a client -server 
computing network. Alternatively, the method may be 
implemented, wholly or at least in part, by dedicated 
authoring hardware . 

As shown in Figure 1, the authoring method of the 
preferred embodiment of the present invention comprises 
three main stages, namely: creating a high-level 
abstraction (or storyboard) representing functional 
sections of a desired audiovisual product in step 101; 
automatically evaluating the high-level abstraction to 
create a fully expanded intermediate structure and a set 
of AV assets in step 102; and creating an output 
datastructure compliant with a DVD-video specification 
using the expanded intermediate structure and AV assets in 
step 103. Suitably, the output datastructure is then 
recorded onto a recording medium, in this case being a 
blank optical disc, to create a DVD- video product. 

The method outlined in Figure 1 will now be explained 
in more detail . 

Firstly, looking at the step 101 of Figure 1, the 
high-level abstraction is created by forming a plurality 
of components that implicitly represent functional 
elements of a desired DVD-video product, and a set of 
transitions that represent movements between the 
components that will occur during playback. 

Figure 2 is a schematic diagram showing a simple 
abstraction of a desired audiovisual product. In the 
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example of Figure 2 there are three components 201, linked 
by two transitions 202. The components 201 represent 
functional elements of the desired audiovisual product, 
where one or more portions of AV content (combinations of 
video clips, audio clips, etc) are to be reproduced during 
playback. The transitions 2 02 indicate legitimate ways in 
which the product moves from one component to another 
during playback. In the example of Figure 2, the 
transitions 202 are all explicitly defined. Suitably, 
each transition 202 is associated with an event 203, which 
indicates the circumstances giving rise to that 
transition. An event 2 03 is a triggering action such as 
the receipt of a user command, or the expiry of a timer, 
that influences movement through the sections of AV 
content during playback. Referring to Figure 2, starting 
from a particular component A, and given all possible 
actions, exactly one event 203 will be satisfied, allowing 
a transition 202 from the current component A to a next 
component B or C. 

The preferred embodiment allows for three different 
types of component. These are an information component, a 
choice component and a meta - component . 

An information component represents what will in due 
course become a single AV asset in the desired audiovisual 
product. Suitably, an information component simply 

comprises a reference to a raw content object or 
collection of raw content objects (i.e. raw video and 
audio clips) that will be used to create an AV asset in 
the audiovisual product. For example, an information 
component refers to a welcome sequence that is displayed 
when the DVD-video product is played in a DVD-video 
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player. The same welcome sequence is to be played each 
time playback begins. It is desired to display the welcome 
sequence, and then proceed to the next component. An 
information component (which can also be termed a simple 
component) is used principally to define presentation data 
in the desired DVD-video product. 

A choice component represents what will become a 
plurality of AV assets in the desired audiovisual product. 
In the preferred embodiment, the choice component 
(alternately termed a multi -component ) comprises a 
reference to at least one raw content object,, and one or 
more parameters. Here, for example, it is desired to 
present a welcome sequence in one of a plurality of 
languages, dependent upon a language parameter. That is, 
both a speaker's picture (video stream) and voice track 
(audio stream) are changed according to the desired 
playback language. Conveniently, a choice component is 
used to represent a set of desired AV assets in the 
eventual audiovisual product, where a value of one or more 
parameters is used to distinguish between each member of 
the set. Hence, a choice component represents mainly 
presentation data in a desired DVD-video product, but also 
represents some navigational structure (i.e. selecting 
amongst different available AV assets according to a 
language playback parameter) . 

A met a -component comprises a procedural ly-defined 
structure representing a set of information components 
and/or a set of choice components, and associated 
transitions. Conveniently, a met a- component may itself 
define subsidiary meta - components . A me ta- component is 
used principally to define navigational structure in the 
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desired audiovisual product, by representing other 
components and transitions. 

Figure 3 shows a choice component or information 
component 201 in more detail. The .component is reached by 
following one of a set of incoming transitions 202, 
labelled Ti(l...n), and is left by following one of a set of 
outgoing transitions To(l...m). 

The component 2 01 is defined with reference to zero or 
more parameters 301, which are used only during the 
authoring process. However, the component may also be 
defined with reference to zero or more runtime variables 
302. Each variable 302 records state information that can 
be read and modified within the scope of each component, 
during playback of the audiovisual product such as in a 
standard DVD player. Conveniently, the component 201 is 
provided with a label 303 for ease of handling during the 
authoring process . 

The component 201 contains references to one or more 
items of content 3 04. The items of content are raw 
multi-media objects (still picture images, video clips, 
audio clips, text data, etc.) recorded in one or more 
source storage systems such as a file system, database, 
content management system, or asset management system, in 
any suitable format such as .gif, .tif, .bmp, .txt, .rtf, 
.jpg, .mpg, .qtf, .mov, .wav, .rm, .qtx, amongst many 
others. It will be appreciated that these raw content 
items are not necessarily at this stage in a format 
suitable for use in the DVD-video specification, which 
demands .that video, audio and sub-picture objects are 
provided in selected predetermined formats (i.e. MPEG). 
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Each component 2 01 uses the references as a key or 
index which allows that item of content to be retrieved 
from the source storage systems. The references may be 
explicit (e.g. an explicit file path), or may be 
determined implicitly, such as with reference to values of 
the parameters 301 and/or variables 302 (i.e. using the 
parameters 301 and/or variables 3 02 to construct an 
explicit file path) . 

Conveniently, the component 2 01 also comprises a 
reference to a template 3 05. The template 3 05 provides, 
for example, a definition of presentation, layout, and 
format of a desired section of AV content to be displayed 
on screen during playback. A template 3 05 draws on one or 
more items of content 304 to populate the template. 
Typically, one template 305 is provided for each component 
201. However, a single template 305 may be shared between 
plural components 2 01, or vice versa. A template 3 05 is 
provided in any suitable form, conveniently as an 
executable program, a plug-in or an active object. A 
template is conveniently created using a programming 
language such as C++, Visual Basic, Shockwave or Flash, or 
by using a script such as HTML or Python, amongst many 
others. Hence, it will be appreciated that a template 
allows a high degree of flexibility in the creation of AV 
assets for a DVD-video product. Also, templates already 
created for other products (such as a website) may be 
reused directly in the creation of another form of 
audiovisual product, in this case a DVD-video product. 

The parameters 3 01, runtime variables 3 02, content 
items 304 and template 3 05 together allow one or more AV 
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assets to be produced for use in the desired audiovisual 
product. Advantageously, creating a component 201 in this 
parameterised form allows a large plurality of AV assets 
to be represented simply and easily by a single component. 

To illustrate the power and advantages of creating 
components 201 and transitions 202 as described above, 
reference will now be made to Figure 4 which compares a 
typical prior art method for authoring an audiovisual 
product against the preferred embodiment of the present 
invention. In this example it is desired to develop an 
audiovisual product which allows the user to play a simple 
quiz game. 



In Figure 4a, each AV asset 401 which it is desired to 
present in the eventual audiovisual product must be 
created in advance, and navigation between the assets 
defined using navigation links represented by arrows 402. 
Here, the game involves answering a first question, and, 
if correct, then answering a second question. The answer 
to each question is randomised at runtime using a runtime 
variable such that one of answers A, B and C is correct, 
whilst the other two are incorrect. In this simple 
example of Figure 4a it can be seen that a large number of 
assets need to be created, with an even greater number of 
navigational links. Hence, the process is relatively 
expensive and time consuming, and is prone to errors. 

Figure 4b shows an abstraction, using components and 
transitions as described herein, for an equivalent quiz 
game. It will be appreciated that the abstraction shown 
in Figure 4b remains identical even if the number of 
questions increases to ten, twenty or even fifty 
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questions, whereas the representation in Figure 4a becomes 
even more complex as each question is added. 

Figure 5 shows another example abstraction using 
5 components and transitions. Figure 5 illustrates an 
example abstraction for an audiovisual product that will 
contain a catalogue of goods sold by a retail merchant. A 
welcome sequence is provided as an information component 
201a. Choice components 201b are used to provide a set of 

10 similar . sections of AV content such as summary pages of 
product information, or pages of detailed product 
information including photographs or moving video, for 
each product in the catalogue. Here, the catalogue 
contains, for example, of the order of one thousand 

15 separate products, each of which will result in a separate 
AV asset in the desired DVD-video product. 
Meta-components 201c provide functions such as the 
selection of products by category, name or by part code. 
These meta-components are procedurally defined. 

20 

Figure 6 shows a tabular representation for the: 
abstraction shown in schematic form in Figure 5. 

In use, the authoring method and apparatus suitably 
25 presents a convenient user interface for creating 
components and transitions of the high-level abstraction. 
Ideally, a graphical user interface is provided allowing 
the definition of components, transitions and events, 
similar to the schematic diagram of Figure 5. Most 
30 conveniently, the user interface provides for the 
graphical creation of components such as by drawing boxes 
and entering details associated with those boxes, and 
defining transitions by drawing arrows between the boxes 



17 



and associating events with those arrows. Alternatively, a 
tabular textual interface is provided similar to the table 
of Figure 6 . 

Referring again to Figure 1, the abstraction created 
in step 101 is itself a useful output. The created 
abstraction may be stored for later use, or may be 
transferred to another party for further work. However, in 
most cases the authoring method is used to automatically 
create a final audiovisual product, such as a DVD-video 
product, from the abstraction. 

Referring to Figure 1, the method optionally includes 
the step 104 of checking for compliance with a DVD 
specification. It is desired to predict whether the 
resulting DVD- video product will conform to a desired 
output specification, in this case the DVD-video 
specification. For example, the DVD-video specification 
has a hierarchical structure with strict limits on a 
maximum number of objects that may exist at each level, 
and limits on the maximum quantity of data that can be 
stored on a DVD- video disc. 

In one embodiment, the checking step 104 is performed 
using the created components 201 and transitions 202. As 
discussed above, the components 2 01 contain references to 
raw AV content objects 304 and templates 305, and 
authoring parameters 301, 302, that allow AV assets to be 
produced. The checking step 104 comprises predicting a 
required number of objects at each level of the 
hierarchical structure, by considering the number of 
potential AV assets that will be produced given the 
possible values of the authoring parameters (i.e. 
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authoring -only parameters 3 01 and runtime variables 3 02) , 
and provides an indication of whether the limits for the 
maximum number of objects will be exceeded. Similarly, 
where a component defines a set of similar AV assets, then 
5 it is useful to predict the physical size of those assets, 
and so check that the audiovisual product is expected to 
fit within the available capacity of a DVD disc. 
Advantageously, the conformance check of step 104 is 
performed without a detailed realisation of every AV 

10 asset, whilst providing an operator with a reasonably 
accurate prediction of expected conformance. If 
non-conformance is predicted, the operator may then take 
steps, at this early stage, to remedy the situation. As a 
result, it is possible to avoid unnecessary time and 

15 expense in the preparation of a full audiovisual product 
which is non-conformant. 

As shown in Figure 1, in step 102 the components 2 01 
and transitions 2 02 of the high level abstraction 2 00 are 
20 automatically evaluated and expanded to create AV assets 
and an intermediate datastucture of nodes and links. 
Figure 7 shows the step 102 of Figure 1 in more detail. 

The components 201 and transitions 2 02 may be 
25 evaluated in any order, but it is convenient to first 
evaluate the components, and then to evaluate the 
transitions. Ideally, any meta-components in the 

abstraction are evaluated first. Where a met a- component 
results in new components and transitions, these are added 
30 to the abstraction, until all meta-components have been 
evaluated, leaving only information components and 
parameterised choice components. 
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An expanded intermediate datastructure is created to 
represent the abstract components 201 and transitions 2 02 
in the new evaluated form* This expanded datastructure 
comprises branching logic derived from the events 203 
attached to the transitions 2 02 (which will eventually 
become navigation data in the desired audiovisual product) 
and nodes associated with AV assets derived from the 
components 201 (which will eventually become presentation 
data in the audiovisual product) . However, it is not 
intended that the expanded datastructure is yet in a 
suitable form for creating an audiovisual product in a 
restricted format such as a DVD-video product, since at 
this stage there is no mapping onto the hierarchical 
structure and other limitations of the DVD- video 
specification. 

Figure 8 shows step 701 of Figure 7 in more detail, to 
explain the preferred method for evaluating the components 
201. As shown in Figure 8, each information component 201a 
and each choice component 2 01b is selected in turn in step 
801. Each component 201 is evaluated to provide one or 
more AV assets in step 8 02. In an information component, 
this evaluation comprises creating an AV asset from the 
referenced raw content objects 3 04. In a choice component, 
this evaluation step suitably comprises evaluating a 
template 305 and one or more raw content objects 304 
according to the authoring parameters 301/302, to provide 
a set of AV assets. Suitably, a node in the expanded 
datastructure is created to represent each AV asset, at 
step 803. At step 804, entry logic and/or exit logic is 
created to represent a link to or from each node such that 
each AV asset is reached or left under appropriate runtime 
conditions . 
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Figure 9 shows a preferred method for evaluating 
transitions in step 702 of Fig. 7. Each transition 202 is 
selected in any suitable order in step 901. In step 902 
5 the conditions of the triggering event 203 associated with 
a particular transition 2 02 are used to create entry 
and/or exit logic for each node of the expanded 
datastructure. In step 903 explicit links are provided 
between the nodes . 

10 

; Figure 10 is a schematic illustration of a component 
201 during evaluation to create a set of nodes 110 each 
associated with an AV asset 120, together with entry logic 
132 and exit logic 134, defining movement between one node 

15 110 and the next. The entry logic 132 and exit logic 134 
reference runtime variables 3 02 which are available during 
playback (e.g. timer events, player status, and playback 
states), and the receipt of user commands. Conveniently, 
the evaluation step consumes each of the authoring-only 

20 parameters 301 associated with the abstract components 
201, such that only the runtime variables 302 and runtime 
actions such as timer events and user commands remain. 

Referring again to Figure 1, a conformance checking 
25 step 105 may, additionally or alternatively to the 
checking step 104, be applied following the evaluation 
step 102 . Evaluation of the abstraction in step 102 to 
produce the expanded datastructure 100 allows a more 
accurate prediction of expected compliance with a 
30 particular output specification. In particular, each node 
of the expanded datastructure represents one AV asset, 
such that the total number of AV assets and object 
locations can be accurately predicted, and the set of AV 
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assets has been created, allowing an accurate prediction 
of the capacity required to hold these assets. 
Conveniently, information about conformance or non- 
conformance is fed back to an operator. Changes to the 
5 structure of the product can then be suggested and made in 
the abstraction, to improve compliance. 

Referring to Figure 1, in step 103 the expanded 
datastructure from step 102 is used to create an 
10 audiovisual product according to a predetermined output 
format, in this case by creating specific structures 
according to a desired DVD-video specification. 

Figure 11 shows an example method for creation of the 
15 DVD video structures. In step 1101, the nodes 110 in the 
expanded datastructure are placed in a list, such as in an 
order of the abstract components 2 01 from which those 
nodes originated, and in order of the proximity of those 
components to adjacent components in the abstraction. As 
20 a result, jumps between DVD video structure locations 
during playback are minimised and localised, in order to 
improve playback speed and cohesion. 

Each node is used to create a DVD video structure 
25 location at step 1102. Optionally at step 1103 if the 
number of created DVD video structure locations exceeds 
the specified limit set by the DVD-video specification 
then creation is stopped at 1104, and an error reported. 
Assuming the number of structures is within the specified 
30 limit then DVD video compatible datastructures are created 
at step 1105. Finally, a DVD video disc image is created 
at step 1106. Conveniently, commercially available tools 
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are used to perform step 1106, and need not be described 
in detail here. 

Step 1102 is illustrated in more detail in Figure 12. 
In this example variable T represents a number of a video 
title set VTS (ie. from 1-99) whilst variable P represents 
a program chain PGC (ie. from 1-999) within each video 
title set. As shown in Figure 12 the nodes 110 of the 
expanded datastructure 100 are used to define locations in 
the video title sets and program chains. As the available 
program chains within each video title set are consumed, 
then the locations move to the next video title set. 
Here, many alternate methods are available in order to 
optimise allocation of physical locations to the nodes of 
the expanded datastructure. 

Step 1105 of Figure 11 is illustrated in more detail 
in Figure 13. Figure 13 shows a preferred method for 
creating DVD-video compatible datastructures by placing 
the AV assets 120 associated with each node 110 in the 
structure location assigned for that node, and 
substituting links between the nodes with explicit 
references to destination locations. At step 1307 this 
results in an explicit DVD compatible datastructure which 
may then be used to create a DVD disc image. Finally, the 
DVD disc image is used to record a DVD disc as a new 
audiovisual product . 

The DVD authoring method and apparatus described above 
have a number of advantages. Creating components that 
represent parameterised sections of audio visual content 
allow many individual AV assets to be implicitly defined 
and then automatically created. Repetitive manual tasks 
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are avoided, which were previously time consuming, 
expensive and error-prone. The authoring method and 
apparatus significantly enhance the range of features 
available in existing categories of audiovisual products 
5 such as movie presentations. They also allow new 
categories of audiovisual products to be produced. These 
new categories include both entertainment products such as 
quiz-based games and puzzle -based games , as well as 
information products such as catalogues, directories, 

10 reference guides, dictionaries and encyclopaedias. In 
each case, the authoring method and apparatus described 
herein allow full use of the video and audio capabilities 
of DVD specifications such as DVD-video. A user may 
achieve playback using a standard DVD player with ordinary 

15 controls such as a remote control device. A DVD-video 
product having highly complex navigational content is 
readily created in a manner which is simple, efficient, 
cost effective and reliable. 

20 Although a few preferred embodiments have been shown 

and described, it will be appreciated by those skilled in 
the art that various changes and modifications might be 
made without departing from the scope of the invention, as 
defined in the appended claims. 
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Claims 

1. An authoring method for use in creating an 
audiovisual product, comprising the steps of: 

5 

defining a plurality of components, the components 
implicitly representing functional sections of audiovisual 
content with respect to one or more raw content objects, 
and a plurality of transitions that represent movements 
10 between the plurality of components; 

expanding the plurality of components and the 
plurality of transitions to provide a set of explicitly 
realised AV assets and an expanded intermediate 
15 datastructure of nodes and links, where each node is 
associated with an AV asset of the set and the links 
represent movement from one node to another; and 

creating an audiovisual product in a predetermined 
20 output format, using the AV assets and the expanded 
intermediate datastructure of the nodes and the links. 

2. The method of claim 1, wherein the defining step 
comprises defining at least one information component that 

25 comprises a reference to a raw content object. 

3. . The method of claim 2, wherein the reference 
denotes a file path to a location where the raw content 
object is stored. 

30 

4 . The method of any preceding claim, wherein the 
defining step comprises defining at least one choice 
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component comprising a reference to at least one raw 
content object, and at least one authoring parameter. 

5. The method of claim 4, wherein the at least one 
5 authoring parameter is adapted to control a selection or 

modification of the at least one raw content object. 

6. The method of claim 4 or 5, wherein the at least 
one authoring parameter comprises a runtime variable 

10 available during playback of the audiovisual product. 

7. The method of claim 4, 5 or 6, wherein the at 
least one authoring parameter comprises an authoring- only 
parameter that will not be available during playback of 

15 the audiovisual product . 

8. The method of any of claims 4 to 7, wherein the 
choice component comprises a reference to a presentation 
template and a reference to at least one substitutable raw 

20 content object to be placed in the template according to 
the at least one authoring parameter. 

9. The method of any preceding claim, wherein the 
defining step comprises defining at least one meta- 

25 component representing a set of components and 
transitions . 

10. The method of claim 9, wherein the at least one 
met a- component is a procedurally defined representation of 

30 the set of components and transitions. 



11. The method of any preceding claim, wherein each 
transition represents a permissible movement from one 
component to another component . 

12. The method of any preceding claim, wherein each 
transition is associated with a triggering event. 

13. The method of claim 12 , wherein the triggering 
event is an event occurring during playback of the 
audiovisual product . 

14. The method of claim 13 , wherein the triggering 
event is receiving a user command, or expiry of a timer. 

15. The method of any preceding claim, further 
comprising the step of checking expected conformance of 
the audiovisual product with the predetermined output 
format, using the plurality of components and the 
plurality of transitions. 

16. The method of claim 15, wherein the predetermined 
output format is a hierarchical datastructure having 
limitations on a number of objects that may exist in the 
datastructure at each level of the hierarchy, and the 
checking step comprises predicting an expected number of 
objects at a level and comparing the expected number with 
the limitations of the hierarchical datastructure. 

17. The method of claim 15 or 16, wherein the checking 
step comprises predicting an expected total size of the 
audiovisual product, and comparing the expected total size 
against a storage capacity of a predetermined storage 
medium. 
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18. The method of any preceding claim, wherein the 
expanding step comprises, for each component, building one 
or more of the set of explicitly realised AV assets by 

5 reading and manipulating the one or more raw content 
objects . 

19. The method of any preceding claim, wherein: 

10 the defining step comprises defining at least one 

choice component comprising a reference to a plurality of 
raw content objects and at least one authoring parameter; 
and 

15 the building step comprises: 

selecting one or more raw content objects from amongst 
the plurality of raw content objects using the at least 
one authoring parameter; and 

20 

combining the selected raw content objects to form one 
of the AV assets. 

20. The method of claim 19, comprising repeating the 
25 selecting and combining steps to automatically build a 

plurality of the explicitly realised AV assets from the 
one of the components . 

21. The method of any preceding claim, wherein the 
30 expanding step comprises: 
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creating from each one of the plurality of components 
one or more explicitly realised AV assets to provide the 
set of AV assets; 

creating the expanded intermediate datastructure 
wherein each node represents one AV asset of the set; and 

creating a set of links between the nodes. 

22. The method of any preceding claim, wherein each 

transition is associated between first and second 
components, and creating the set of links comprises 
evaluating each transition to create one or more links, 
each of the links being between a node created from the 
first component and a node created from the second 
component . 



23. The method of any preceding claim, wherein the 
expanding step comprises evaluating at least one of the 
transitions to create exit logic associated with at least 
one first node, evaluating one of the components to create 
entry logic associated with at least one second node, and 
providing a link between the first and second nodes 
according to the entry logic and the exit logic. 

24. The method of claim 23, wherein at least one of 
the transitions is associated with a triggering event, and 
the expanding step comprises evaluating the triggering 
event to determine the exit logic associated with the at 
least first one node. 

25. The method of any preceding claim, further 
comprising the step of checking expected conformance of 



the audiovisual product with the' predetermined output 
format, using the AV assets and the expanded intermediate 
datastructure of nodes and links. 

26. The method of claim 25, wherein the predetermined 
output format is a hierarchical datastructure having 
limitations on a number of objects that may exist in the 
datastructure at each level of the hierarchy, and the 
checking step comprises predicting an expected number of 
objects at a level and comparing the expected number with 
the limitations of the hierarchical datastructure. 

27. The method of claim 26, wherein the checking step 
comprises predicting an expected total size of the 
audiovisual product, and comparing the expected total size 
against a storage capacity of a predetermined storage 
medium. 

28. The method of any preceding claim, wherein the AV 
assets have a data format specified according to the 
predetermined output format . 

29. The method of any preceding claim, wherein the AV 
assets each have a data format according to the 
predetermined output format, whilst the raw content 
objects are not limited to a data format of the 
predetermined output format . 

30. The method of any preceding claim, wherein the 
predetermined output format is a DVD-video specification. 
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31. The method of any preceding claim, wherein the AV 

assets each comprise a video object, zero or more audio 
objects, and zero or more sub-picture objects. 

5 32. The method of any preceding claim, wherein the AV 

assets each comprise at least one video object, zero to 
eight audio objects, and zero to thirty-two sub-picture 
objects, according to the DVD-video specification. 

10 33 . The method of any preceding claim, wherein the 

creating step comprises creating objects in a hierarchical 
datastructure defined by the predetermined output format 
with objects at levels of the datastructure, according to 
the intermediate datastructure of nodes and links, and 

15 where the objects in the hierarchical datastructure 
include objects derived from the explicitly realised AV 
assets . 

34 . The method of any preceding claim, wherein the 
20 predetermined output format is a DVD-video specification 

and the creating step comprises creating DVD-video 
structure locations from the nodes of the expanded 
intermediate datastructure, placing the explicitly 
realised AV assets at the created structure locations, and 
25 substituting the links of the expanded intermediate 
datastructure with explicit references to the DVD-video 
structure locations . 

35. An authoring method for use in creating a DVD- 
30 video product, comprising the steps of: 

creating a plurality of components representing 
parameterised sections of audiovisual content, and a 
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plurality of transitions representing movements between 
components ; 

expanding the plurality of components and the 
5 plurality of transitions to provide a set of AV assets and 
an expanded datastructure of nodes and links, where each 
node is associated with an AV asset of the set and the 
links represent movement from one node to another; and 

10 creating a DVD-video format datastructure from the AV 

assets, using the nodes and links. 

36. The method of claim 35 or 36, comprising creating 
at least one information component comprising a reference 

15 to an item of AV content. 

37. The method of claim 35, comprising creating at 
least one choice component comprising a reference to at 
least one item of AV content, and at least one parameter 

20 for modifying the item of AV content. 

38. The method of claim 37, wherein the choice 
component comprises a reference to a presentation template 
and a reference to at least one item of substitutable 

25 content to be placed in the template according to the at 
least one parameter. 

39. The method of claim 37 or 38, wherein the choice 
component comprises at least one runtime variable 

30 available during playback of an audiovisual product in a 
DVD player, and at least one authoring parameter not 
available during playback. 
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40. The method of any of claims 35 to 39, comprising 
creating at least one meta- component representing a set of 
components and transitions. 

41. The method of any of claims 35 to 40, wherein each 
transition represents a permissible movement from one 
component to another component, each transition being 
associated with a triggering event . 

42. The method of claim 41, wherein a triggering event 
includes receiving a user command, or expiry of a timer. 

43. The method of any of claims 35 to 42, wherein the 
expanding step comprises: 

creating from each one of the plurality of components 
one or more AV assets to provide the set of AV assets; 

creating the expanded datastructure wherein each node 
represents one AV asset of the set; and 

creating a set of links between the nodes. 

44. The method of claim 3 7 or any claim dependent 
thereon, wherein the expanding step comprises evaluating 
each choice component to create a plurality of AV assets 
according to each value of the at least one parameter. 

45. The method of claim 44, wherein evaluating each 
choice component comprises creating entry logic associated 
with at least one node and/or evaluating at least one 
transition to create exit logic associated with at least 
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one node, and providing a link between a pair of nodes 
according to the entry logic and the exit logic. 

46. The method of any of claims 35 to 45, comprising 
the step of checking expected conformance with the DVD- 
video format using the created components and transitions. 

47. The method of any of claims 35 to 40, comprising 
the step of checking expected conformance with the DVD- 
video format using the set of AV assets and the expanded 
datastructure of nodes and links. 

48. An authoring method for use in creating an 
audiovisual product according to a DVD-video 
specification, comprising the steps of: 

generating a set of AV assets each comprising a video 
object, zero or more audio objects and zero or more sub- 
picture objects, and an expanded datastructure of nodes 
and links, where each node is associated with one AV asset 
of the set and the links represent navigational movement 
from one node to another; and 

creating a DVD-video format datastructure from the set 
of AV assets, using the nodes and links; 

the method characterised by the steps of: 

creating a plurality of components and a plurality of 
transitions, where a component implicitly defines a 
plurality of AV assets by referring to a presentation 
template and to items of raw content substitutable in the 



presentation template, and the plurality of transitions 
represent navigational movements between components; and 



expanding the plurality of components and the 
plurality of transitions to generate the set of AV assets 
and the expanded datastructure of nodes and links. 

49. A recording medium having recorded therein 
computer implementable instructions for performing the 
method of any of claims 1 to 34. 

50. A recording medium having recorded therein 
computer implementable instructions for performing the 
method of any of claims 35 to 47. 

51. A recording medium having recorded therein 
computer implementable instructions for performing the 
method of claim 48. 

52 . A recording medium having recorded thereon an 
audiovisual product authored according to the method of 
any of claims 1 to 34 . 

53. An optical disk recording medium having recorded 
thereon an audiovisual product authored according to the 
method of any of claims 35 to 47. 

54. An optical disk recording medium having recorded 
thereon an audiovisual product authored according to the 
method of claim 48. 
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55. An authoring method for use in creating an 
audiovisual product, substantially as hereinbefore 
described with reference to the accompanying drawings. 

56 . An authoring method for use in creating a 
DVD- video product, substantially as hereinbefore described 
with reference to the accompanying drawings. 

57. An authoring method for use in creating an 
audiovisual product according to a DVD-video 
specification, substantially as hereinbefore described 
with reference to the accompanying drawings. 
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